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Abstract 

We present a novel method called Kernel-SME filter for tracking multiple targets when the associ- 
ation of the measurements to the targets is unknown. The method is a further development of the 
Symmetric Measurement Equation (SME) filter, which removes the data association uncertainty of 
the original measurement equation with the help of a symmetric transformation. The underlying 
idea of the Kernel-SME filter is to construct a symmetric transformation by means of mapping the 
measurements to a Gaussian mixture. This transformation is scalable to a large number of targets 
and allows for deriving a Gaussian state estimator that has a cubic time complexity in the number 
of targets. 



1. Introduction 

A main challenge in multiple target tracking [IJ is that the association of measurements to 
targets is unknown. In this context, a variety of different multiple target tracking methods has 
been developed. For example, the Joint Probabilistic Data Association Filter (JPDAF) [2] enu- 
merates all feasible association hypotheses in order to compute a Gaussian approximation of the 
posterior density of the target states. Unfortunately, the number of possible association hypotheses 
grows exponentially with the number of targets so that the tracking of a large number of closely- 
spaced targets becomes a serious challenge. The Probability Hypothesis Density (PHD) filter [31 S] 
maintains the first moment of the multi-target posterior random set called PHD. By this means, 
association hypotheses are not explicitly enumerated, i.e., data association is performed implicitly. 
The PHD, however, contains significantly less information than the full joint state vector of all 
single targets, e.g., the correlations between targets are lost. 

This article is about an implicit data association approach named Symmetric Measurement 
Equation (SME) filter [5^, "6]. The SME filter removes the data association uncertainty from the 
original measurement equation using a symmetric transformation. By this means, the combinatorial 
complexity of the data association problem can be bypassed. Unfortunately, existing SMEs suffer 
from strong nonlinearities and lack an intuitive semantic so that existing SME filters are not 
competitive to established approaches such as JPDAF and PHD filters. 

In this article, we introduce the so-called Kernel-SME filter that can be seen as an extension of 
the SME approach. The basic idea is to define a symmetric transformation that maps the set of 
measurements to a function, i.e., a Gaussian mixture, and deterministic sampling of this function 
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gives the symmetric transformation. In this manner, a data-dependent, i.e., nonpar ametric, sym- 
metric transformation is obtained. The Kernel-SME has an intuitive semantic and it is suitable for 
a large number of closely-spaced targets due to a cubic time complexity. Hence, the advantages of 
an implicit data association method are exploited while having the full joint density of the multiple 
target state available. Additionally, there is an intriguing connection to the PHD filter that renders 
the Kernel-SME filter to an in-between of the PHD filter and the JPDAF. Simulations demonstrate 
that the Kernel-SME filter may outperform the PHD filter for a large number of targets. 



2. Problem Formulation 

We consider the tracking of multiple targets based on noisy measurements, where the target- 
to-measurement association is unknown. Specifically, we make the following assumptions: 

Al The number of targets is known and fixed. 

A2 Each target gives rise to exactly one single measurement per time instant. 

A3 There are no false measurements, i.e., each measurement originates from a target. 

The n-dimensional single target state vectors are denoted with x^., . . . , , where k denotes the 
discrete time and A'' is the number of targets. The joint target state X/^ = [(^i)^, . . . , {x^)'^~\'^ G 
IR"'^ comprises all single target states. 



2.1. Measurement Model 

At each time step k, a set of N measurements {y^, . . . , y^} is available. Each measurement is 
related to a single target through the linear measurement model 
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where vr^, G n„ is a permutation in the symmetric group n„ that specifies the unknown target- 
to- measurement assignment and additive zero- mean white noise with covariance matrix ^ . 
The single target measurement equations ([T]) can be composed to an overall measurement equation 
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2.2. System Model 

The temporal evolution of a single target is specified by a linear motion model 
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where is the system matrix and is additive white noise with covariance matrix 5^^;- The 
single target motion models ([s]) can be composed as 
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2.3. Recursive Gaussian Estimator 

We aim at a recursive Gaussian state estimator for the multi-target state vector Xf^, i.e., a 
Gaussian approximation of the posterior probability density function for Xj^ given the measurements 
Yk := {y^,...,yj 

p{x,\Yk)=M[x,-t,l- S^) (5) 

is to be computed, where fi^ is the mean and the covariance matrix of the Gaussian. 

The time update step determines p{xi. \ Y^-i) = M — /^^|^_]^; ^fc|/c_i) based on the previous 
density p(x^._i | Yfc_i). Due to the linear system model, the prediction can be performed according 
the Kalman filter formulas 
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In the measurement update step, the prediction M {^x^^ — is updated with the 

stacked measurement vector y^. How to perform the measurement update under incorporation of 
the data association uncertainty is the objective this article. 



3. SME-Filter 

This section is about the Symmetric Measurement Equation (SME) filter as introduced by 
Kamen [5l |6] . The basic idea of the SME filter is to remove the association uncertainty Tit from the 
measurement equation ^ by applying a symmetric transformation to the measurement vector. 

Definition 1. A transformation Siy^ of the measurement vector y^ with S : IR^'" — )■ IR^" is 
called symmetric if 

for all vr G IItv- 
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Remark 1. Of course, the symmetric transformation should not remove information, i.e., it should 
be injective up to permutation. 



Example 1. The Sum-Of-Powers [3 El El E] transformation for two targets and one-dimensional 
measurements and y^. is given by 



s([ylylf) = yl + yl{ylY + {yl) 
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The application of a symmetric function 5 to Q yields 

Sfe := S{P^,{y^)) = 5(Hfc • + Vk) , (9) 



where is a pseudo- measurement constructed from original measurement vector y^. The pseudo- 
measurement Sj^ can be determined without knowing vr^, due to the symmetry property of S. Hence, 
the data association uncertainty has been removed, however, instead a nonlinear measurement 
equation is obtained. Based on the nonlinear measurement equation ([o]), nonlinear Bayesian state 
estimators such as the Extended Kalman Filter (EKF) or Unscented Kalman Filter (UKF) [71 18] 
can be used for performing inference. 

Although the SME approach is a very neat way for dealing with data association uncertainties, 
it comes with some challenges: 

1. ) The generalization of existing symmetric transformations, i.e., the Sum-Of-Powers and [5l[6l 

[71 ISl [9] , to states with dimension larger than 1 is nontrivial due to the so-called ghost target 
problem [3 [8] resulting from non-injective transformations. As a consequence, tedious and 
highly nonlinear symmetric functions that have no intuitive, physical meaning are obtained. 
Additionally, these symmetric transformations are unsuitable for larger target numbers as 
the order of the involved polynomial increases with the number of targets, i.e., for 10 targets 
polynomials up to order 10 are required. 

2. ) Due to 1.), the resulting nonlinear estimation problem is very difficult. As there is non- 

additive Gaussian noise in ([o]), the EKF cannot be applied directly and an approximate 
measurement equation with additive noise has to be derived first. The derivation of the 
additive noise term is usually complicated and time-consuming. Besides, Linear Regression 
Kalman Filters (LRKFs) such as the UKF [71 [8] do not give satisfying results due to the 
strong nonlinearities and numerical instabilities. 



4. Kernel-SME Filter 

The basic idea of the Kernel-SME filter is to interpret the measurements as the parameters of 
a function, where the function is a sum of kernel functions that are placed at the measurement 
locations. We focus on Gaussian kernels, nevertheless other types of kernels may also be reasonable. 

Definition 2 (Kernel Transformation). Let denote the space of all n-dimensional Gaussian 
mixtures with N components. The kernel transformation : IR^'" — )• Ti^^ , which maps y^ G 
]R^'" to a function Fy^ G is defined as 

'^''(^fc) = ^v, ^ith (10) 
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Figure 1: Illustration of the Kernel-SME. 
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where M (^z — y^^; is a Gaussian kernel located at y^^ with kernel width T,^ . 



Remark 2. The transformation (10) is symmetric due to Fy (z) = Fp^(^ -^{z) for all z G IR" 



Furthermore, (10) is injective up to permutation due to the identifiable of the parameters of a 



Gaussian mixture density [TOj. Hence, there is no ghost target problem. 



The transformation (10) has an intuitive semantic: The set of measurements is interpreted as a 



continuous image, i.e., high values of Fy (z) indicate a high measurement concentration. Of course, 



the choice of a suitable kernel width Ti^ in (10) is essential. It should be chosen similar to the 



measurement noise covariance in order to ensure that the support of the kernel covers the noise-free 
measurement. 

The following theorem describes an insightful, inherent relationship between the transformed 
measurements S^{y^) and the PHD of the stacked measurements y^ that is defined as 



(12) 



where Dy^{y) is the PHD function and Pyi {y) is the probability density of t/^. 

Theorem 1. The expected kernel transformation of the stacked measurements y^ coincides with 
the convolution of the PHD with the kernel, i.e., E|5''^^(y^)| = J Dy^{s) -M [s — z; S^) ds 

Proof. According to [TTj, the following holds 

E{Fy^is)} = J Fyjs)piy^)dy^ = J J ^ 5(t - y^) • (t - S^) dtp(y^)dy^ 



- y;) p{y^) dy^ • (t - s; S^) dt = / Dy^ (t) • AA - s; S^) dt 



□ 
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In order to apply standard nonlinear estimation techniques for determining the estimate ([s]), 
we propose to evaluate the function Fy [z] at specific test vectors a^i-.-jO^", i.e., we define a 



discretized version of ( 10 ) as follows 



(13) 



How to choose the number and locations of the test vectors is discussed in Section 14. 1[ 
The application of ( 13 ) to ^ gives the following symmetric measurement equation 
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where Sj^ is the pseudo- measurement. 

We derive a Linear Minimum Mean Squared Error (LMMSE) estimator [12]. For a given pre- 
diction of the state with estimation error the updated estimate /U^ and according 



to ( 14 ) is given by the Kalman filter formulas 
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where 



• is the predicted pseudo- measurement, 

• is the covariance between the state vector Xj. and the pseudo-measurement , and 

• is the variance of the pseudo- measurement Sj. . 

Intuitively, the above filter minimizes the kernel distance between the PHD of the predicted 
measurements and the measurements. In this context, see also jllj . 



Closed-form expressions for the above moments are derived in Section 4.2 With these expres- 



sions, the computational complexity of the Kalman filtering update (15) and (16) is only cubic 



in the number of targets: The mean ^u* can be computed in quadratic time, and both the cross- 
covariance matrix E^* and covariance matrix T,^^ have a cubic time complexity (see Section 4.2). 
Hence, the overall time complexity of the measurement update is cubic. 

4-1- Selecting the Test Vectors 

The locations of the test vectors are crucial. Fortunately, there is an intuitive interpretation: As 



the test vectors can be seen as deterministic samples of the Gaussian mixture (11), there is a strong 



relationship to deterministic sampling problems that occur for example in the UKF |13) . Due to 
this analogy, we propose to add 2 • n test vectors for each Gaussian component J\f (^z — y''^- I 
(HI according to the UKF p3j, i.e., Na = 2 ■ n ■ N with 
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(oT i = 1, . . . ,N and I = 1, . . . ,n, where [^/nE^). denotes the i-th column of y^nS^. For diagonal 
S^, the test points lie on the principal components of S^. 

4-2. Closed-Form Expressions 

The moments required for the measurement update step can be calculated in closed form. 
Essentially, the derivations are straightforward as they can be performed with the help of the 
Kalman filtering formulas. For this purpose, we define the abbreviation 

Pi,l := Ar(4-HiMf; HiS^|,_,(Hif + E^, + S^) . 
The mean of the predicted pseudo-measurement /Lt^ 

N 
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N 
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The cross-covariance matrix between the multi-target state vector and the pseudo-measurement 
becomes = [S^'i, . . . , S^'^"] with 



= E{^fe • I yk-i} -l^l ■ M^fe,, , where 
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The covariance matrix of the predicted pseudo-measurement = (S^'*^ )i,j=i,...,Na can be calcu- 
lated with 



= E{i^y,(4) • FyM^ I yk-i} -Hi, ■ l^l^ , where 
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(a) Initial target positions (big 
dots) and an example ran- 
dom walk taken by the targets 
(small dots). 
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(b) Example measurements. 
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(c) Mean OSPA Error: 
Kernel-SME (blue) and 
GM-PHD (magenta) filter. 



Figure 2: Simulations: Setting and results for the first 15 time steps. 



5. Evaluation 

The performance of the Kernel-SME filter is demonstrated with respect to the Gaussian mixture 
implementation of the PHD filter (GM-PHD) |3]. For this purpose, eight two-dimensional targets 



that evolve according to a random walk model are considered (see Fig. 2a), i.e., N = 2 and 
n = 8 with parameters = = I2, T,'" = 0.1, and S"' = 0.1, where I2 is the identity matrix 
of dimension 2. The measurement noise is rather high compared to the distance of the targets. 
The first estimate is initialized with the covariance matrix = 0.5 • lie and the mean //^' is 
sampled randomly from M {xq — 0; Eg), where denotes the true target position at time instant 
0. The GM-PHD filter maintains a Gaussian mixture with 50 components in order to represent 
the PHD. The parameters for the Gaussian mixture reduction have been optimized for the best 
results and the mixture components with the largest weights serve as point estimates for the single 
targets. As the PHD filter itself does not maintain target labels, the performance of both filters is 
assessed with the Optimal Sub-Pattern Assignment (OSPA) metric [H:] that ignores target labels. 



The averaged OSPA distance over 30 Monte Carlo runs is depicted Fig. 2b The Kernel-SME filter 
significantly outperforms the PHD filter in this scenario. The reason is that the PHD tends to merge 
closely-spaced targets. The simulations demonstrate that the Kernel-SME filter is advantageous in 
particular settings. However, please note that the PHD filter is more general than the presented 
Kernel-SME filter version, e.g., the PHD filter is capable of estimating the number of targets. 



6. Conclusions 

This article presented a novel type of SME filter that is based on a mapping from the set 
of measurements to a Gaussian mixture. Intuitively, the filter recursively minimizes the kernel 
distance between the measurements and the PHD of the predicted measurements. By this means, 
shortcomings of existing SME approaches are remedied so that Kernel-SME filter is a serious 
alternative to traditional tracking algorithms such as JPDAF and PHD filters. The Kernel-SME 
filter is in particular advantageous for a large number of closely-spaced targets. Future work focuses 
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on extending the Kernel-SME to clutter measurements and detection probabilities (see A2 and A3 
in Section [2]). 
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